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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



international aplication No. 
PCT/KR00/00486 



I. Basis of the report 



I . With regard to the elements of the international application:* 
[ | the international application as originally filed . 



2. 



4. 



pCl the descriptio 
pages uq 
pages *~ 



. as originally filed 
* , filed with the demand 



pages 



, tiled with the letter ot 



El 



the claims: 

pages 

pages 

pages 
pages 



, as originally filed 
, as amended (together with any statment) under Article 19 

, filed with the demand 



10 - l| 



i filed with the letter of 10 August 2001 



£T] the drawings: 
pages 1-5 

pages 

pages 



, as originally filed 
, filed with the demand 



, filed with the letter of 



r_J the sequence listing part of the description: 

pages 

pages 

pages 



, as originally filed 
, filed with the demand 



, filed with the letter of 



With regard to the language, all the elements marked above were available or furnished to this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language English which is 

| | the language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 
[X~[ the language of publication of the international application^ under Rule 48.3(b)). 

□ the language of the translation furnished for the purposes of international preliminary exam ination( under Rules 55.2 and/ 
or 55.3). 

With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 
preliminary examination was carried out on the basis of the sequence listing: 

contained inthe international application in written form. 

filed together with the international application in computer readable form. 

furnished subsequently to this Authority in written form. 

furnished subsequently to this Authority in computer readable form 

The statement that the subsequently furnished written sequence listing does not go beyond the disc losure in the 
international applicationas as filed has been furinshed. 

The statement that the information recorded in computer readable form is identical to the written sequence listing has 
been furnished. 



□ 
□ 
□ 
□ 
□ 

□ 



The amendments have resulted in the cancellation of: 

I I the description, pages 
the claims, Nos. 3 
| [ the drawings, sheet 



5. J™~J This opinion has been drawn as if (some of) the amendments had not been made, since they have been considered to go 
beyond the disclosure as filed, as indicated in the Supplemental Box(Rule 70.2(c)).** 

* Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 are referred to 
in this opinion as "originally filed. " and are not annexed to this report since they do not contain amendments (Rules 70. 16 
and 70. 1 7). 

** Any replacement sheet containing such amendments must be referred to under item I and annexed to this report. 
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V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



1 . Statement 

Novelty (N) Claims _J^j YES 

Claims NO 

Inventive step (IS) Claims ^ YES 

Claims NO 

Industrial applicability (I A) Claims ^ YES 

Claims NO 



2. Citations and explanations (Rule 70.7) 

1) Reference is made to the following documents; 
Di: JP patent No. 6-113340(Fuj i ta Corp., 1994.4.22) 
D2: JP patent No. 5-153488(Sony Corp., 1993.6.18) 

2) Claim 1 has been amended. The scope of this claim has not been extended 
beyond the disclosure of the patent application as filed. 

3) Dl teaches that converted signals from a number of analog cameras are 
selected and control led to a video data and composed in one image to save 
and display the image. D2 teaches that the video data assembly is a matrix 
of m x n frames to divide one rectangular display into a number of segment 
displays and the segmented analogue data is converted to a digital data, 
which is controlled and converted to a analogue video data to compose one 
image. None of the available prior art discloses the calibration data input 
for inputting a reference point of each segment display to the controller. 
Consequently, claims 1-4 meet the the requirement of novel ty( Art .33(2) PCT) 
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DttGE COMPOSITING SYSTEM OP MOLTICAMERA AMD METHOD 

THEREOF 

Technical Field 

The present invention relates to an image 
5 composing system capable of taking a picture of high 
resolution in a high speed by composing videos taken by 
a number of video cameras in one video and a method 
thereof. 

Background Art 

10 Generally, in order to obtain a digital video of 

high resolution, a digital scanner or a digital video 
camera is used. The digital scanner scans vertically by 
using a charge coupled device arranged in series, and 
the digital video camera takes a picture by using a 

15 charge-coupled device arranged in a matrix. 

In case of using the digital scanner or the 
digital video camera, there is needed a very expensive 
device to achieve a video of high resolution and high 
quality. Accordingly, a user uses a conventional 

20 inexpensive analog video camera, by which a video data 
cannot be processed. 

Even though the conventional expensive digital 
video camera capable of easily processing the video data 
and saving a kind of data is used, the increase of the 

25 resolution is limited. Since the more increase of the 
resolution is the more reduction of processing speed, it 
is impossible to take a picture quickly. 

In addition, since the dimension of a target area 
pictured by the conventional digital video camera is in 

30 inversely proportional to the resolution, it is 
impossible to take a picture of a large display such as 
a display of a theater. 



inexpensive analog camera. 

The system further comprises a calibration data 

display to the controller to reduce an error produced 
5 from discordance of the segment displays. 

According to another aspect of the present 
invention, there is provided with, in an image composing 
system comprising a camera assembly consisting of a 
number of analog cameras, a video signal selector for 

10 connecting a signal path of each camera, a video signal 
converter for converting a video signal received from 
the camera into a digital signal, a controller for 
composing each digital video signal of the camera in one 
video ^ to convert a video data, and a calibration data 

15 input for inputting a reference point of each segment 
display to the controller, a method of composing the 
image by using the image composing system, the method 
comprising the steps of: operating the cameras of the 
camera assembly by receiving a control signal from the 

20 controller; inputting a reference point of each segment 
display through the calibration data input to calibrate 
a discordance of the segment displays with reference to 
a display on the controller; if the initialing step on 
each camera is completed, selecting an interested camera 

25 and connecting the signal path by the video signal 
selector; converting the analog signal from the selected 
camera into the digital signal; converting each digital 
video signal converted at the above step into the 
digital video data; calibrating the video data converted 

30 at the above step by the reference point inputted at the 
input step and composing, the video data in one video; 
and saving and displaying the composed video data at the 
calibrating step. 



Brief Description of the Drawings 
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Fig. 2, has a number of analog cameras each arranged in 
a divided target area, wherein the camera assembly is a 
matrix of m x n cameras to divide one rectangular 
display into a number of segment displays. 
5 Such a camera assembly may consist of an inexpensive 

analog video camera, and comprises a camera supporting 
frame (not shown) for supporting the camera 1 and for 
adjusting an orientation of the camera 1. A kind of 
camera supporting frames has been suggested in the prior 
10 art. 

When the camera 1 is installed onto the camera 
supporting frame, corners of the segment displays are 
preferably arranged to coincide with each other by 
adjusting the orientation of the cameras. Since it is 

15 very difficult to arrange the camera to coincide with 
the corners of segment display, however, the cameras are 
preferably arranged so that the target areas are 
overlapped with each other. 

The video signal selector 20 is to connect the 

20 signal path of the camera by sequentially selecting one 
by one among the number of cameras or by selecting one 
row or column among the cameras. 

The video signal converter 30 is to convert a video 
signal received from the camera 1 connected to the video 

25 signal selector 20 into a digital video signal, and it 
will be understood by those skilled in the art that 
various changes in form and details may be made. 

The controller 40 is to control the operation of the 
camera assembly 10, the video signal selector 20 and the 

30 video signal converter 30, and to compose each digital 
video signal of the camera 1 converted in the video 
signal converter 30 in one video and save it therein. 
The controller may be one of a controller of a common 
personal computer or a workstation having an image 

35 composing program, and a super computer. 



The above object, other features and advantages of 
the present invention will become more apparent by 

reference to the accompanying drawings, in which:. 

Fig. 1 is a top view illustrating an image 
composing system according to a preferred embodiment of 
the present invention; 

Fig. 2 is a front view illustrating a camera 
arrangement of an image composing system according to a 
preferred embodiment of the present invention; 

Fig. 3 is a flowchart of an image composing method 
according to a preferred embodiment of the present 
invention; 

Fig. 4 is a view illustrating normal reference 
points of segment displays which are divided into four; 
and 

Figs. 5 to 8 are views illustrating an example of 
distorted segment display. 

Best Mode for Carrying Out the Invention 

Now, a preferred embodiment of the present invention 
will be described in detail with reference to the 
accompanying drawings. 

As shown in Fig. 1, the image composing system 
according to a preferred embodiment of the present 
invention comprising a camera assembly 10 consisting of 
a number of analog cameras 1, a video signal selector 20 
for connecting a signal path of each camera 1, a video 
signal converter 30 for converting a video signal 
received from the camera 1 into a digital signal, a 
controller 40 for composing each digital video signal of 
the camera 1 in one video to convert a video data, and a 
calibration data input 50 for inputting a reference 
point of each segment display to the controller 40. 

Specifically, the camera assembly 10, as shown in 
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The image composing program is not to process a mere 
function of overlapping the videos, but to calibrate the 
video with reference to a reference point inputted by an 
user so that the image is coincided with the actual 
5 video of the target area. 

Such an image composing program is to predict all 
distortion of the images taken by each camera and to 
calibrate the images, as shown in Figs. 5 to 8. As shown 
in Fig. 4, the corners of the segment display are 

10 indicated by P iA , P iB , P ic , and P iD/ respectively (wherein i 
is a number of camera) , a reference coordinate of the 
target area in Fig. 4 is indicated by {x, y} and a 
reference coordinate of the target area in Figs. 5 to 8 
is indicated by {X, Y}. 

15 Four corners are rarely positioned on their exact 

position as shown in Fig. 4. Substantially, due to the 
mounting error of the camera, the error of a lens, or 
the machining error of components, the corners are 
rotated as shown in Fig. 5, a magnification of the video 

20 is changed as shown in Fig. 6, the corners are distorted 
in every directions as shown in Figs. 7 and 8, or these 
phenomenon may be complicatedly happened. 

Therefore, in order to compose the displays shown in 
Figs. 5 to 8 as the display shown in Fig. 4, the 

25 coordinate of the actual display has to convert into the 
coordinate of the target display. 

Specifically, the formula of this coordinate is 
expressed by x = f x (X, Y) , y = f y (X, Y) by using a linear 
geometry and coordinate principal. 

30 Wherein (X, Y) is a coordinate of four points P' iA , 

p, iB' and p/ iD of the actual display, these points 

are converted from the coordinate {X, Y} of the actual 
display into the in to the coordinate of four points P iA , 
P iB , P ic , and P iD by a temporary coordinate {x, y}. 

35 Therefore, the user can eliminate the error of the 



I 
1 

a 

display or the overlapped display by designating the 
positions of four corners or particular reference points 
of t h 3 .?.c-u "i! ■ ; i i y\ u > r *.'li v t u 3 i-Vj n >~ % * j "* * 

The coordinate converting function suitable to the 
5 magnifying/reducing conversion, the distorting 
conversion, the rotating conversion, and it will be 
understood by those skilled in the art that various 
changes in form and details may be made. The initialing 
process is achieved by one setting operation if the 
10 distance of the camera assembly and the target display 
is constant. 

The image composing system of the present invention 
further comprises a calibration data input 50, such as a 
mouse, ^ a keyboard, a joystick, or a touch screen, for 

15 inputting a reference point of each segment display to 
the controller 4 0 to reduce the error produced from the 
discordance of the segment displays. 

Referring to Fig. 3, the method of composing several 
images according to the present invention comprises the 

20 steps of; taking a picture of the target area (step SI); 
initialing picture conditions (step S2); selecting a 
particular camera (step S3); receiving a video signal 
from the selected camera (step S4); processing videos of 
segment displays (step S5) ; composing the segment 

25 displays (step S6) ; and processing the composed display 
(step S7) . 

Specifically, if the video composing system of the 
v present invention is installed on a particular position, 
the camera 1 of the camera assembly 10 is received with 
30 a control signal of the controller 40 to take a picture 
of the target area (step SI) . 

At the initialing step S2, the user inputs a 
reference point of each segment display through the 
calibration data input 50 to calibrate the discordance 
35 of the segment displays with reference to the display on 
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the controller 40. 

At the selecting step S3, if the initialing step on 
each camera is completed, the video signal selector 20 
selects the interested camera 1 and connects the signal 
5 path. 

At the receiving step S4, the analog signal from the 
selected camera is converted into the digital signal. 

At that time, the controller 40 controls the video 
signal selector 20 to sequentially select each camera 1 
10 till the video signals of all camera is converted into 
the digital signal. 

At the processing step S5, each digital video signal 
converted at the step S4 is converted into the digital 
video data. 

15 At the composing step S6, the video data converted 

at the step S5 is calibrated by the reference point 
inputted at the step S2 and is composed in one image. 

At the processing step S7, the composed video data 
at the step S6 is saved and is displayed. 

20 And then, the above processes are competed or 

repeated to achieve the precise picture. 

According to the method of composing images 
according to the present invention, it will overcome the 
picturing errors predicted at the initialing process, 

25 the display is sequentially pictured by • using a number 
of cameras, and the pictured video data is converted and 
composed. 

Industrial Applicability 

As apparent from the above description, the image 
30 composing system according to the present invention may 
reduce a cost of system and take a picture of a high 
resolution, by using an inexpensive analog. 

Accordingly, the user may take a picture of a 
digital video, which the data is easily processed and 



saved, by using an analog camera cheaper than a digital 
camera . 

By using ::h, Irriu- e^pos.Liy jyjz^n ci-J .h3 method 
thereof, since it can increase the resolution regardless 
of the dimension of the target area to be pictured, it 
is possible to take a picture of a large display such as 
a display of a theater and easily edit the video. 
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Claims 

1. An image composing system comprising: 

a camera assembly having a number of analog cameras, 
each arranged in a divided target area; 
5 a video signal selector for selecting a particular 

camera for connecting a signal path of the camera; 

a video signal converter for converting a video 
signal received from the camera connected to the video 
signal selector into a digital video signal; and 
10 a controller for controlling operation of the camera 

assembly, the video signal selector and the video signal 
converter, and for converting each digital video signal 
of the cameras converted in the video signal converter 
into a video data and composing it in one image to save 
15 and display the image. 

2. The system as claimed in claim 1, wherein 
the camera assembly is a matrix of m x n cameras to 
divide one rectangular display into a number of segment 
displays. 

20 3. The system as claimed in claim 1, further 

comprising a calibration data input for inputting a 
reference point of each segment display to the 
controller to reduce an error produced from discordance 
of the segment displays. 

25 4. In a video composing system comprising a 

camera assembly consisting of a number of analog 
cameras, a video signal selector for connecting a signal 
path of each camera, a video signal converter for 
converting a video signal received from the camera into 

30 a digital signal, a controller for composing each 
digital video signal of the camera in one image to 



convert a video data, and a calibration data input for 
.inputting a reference point of each segment display to 

the controll-v, n T-thod oc -crpozLr.j th- \r^ :2 by using 
the image composing system, the method comprising- the 
steps of: 

operating the cameras of the camera assembly by 
receiving a control signal from the controller; 

.inputting a reference point of each segment display 
through the calibration data input to calibrate a 
discordance of the segment displays with reference to a 
display on the controller; 

if the initialing step on each camera is completed, 
selecting an interested camera and connecting the signal 
path by the video signal selector; 

converting the analog signal from the selected 
camera into the digital signal; 

converting each digital video signal converted at 
the above step into the digital video data; 

calibrating the video data converted at the above 
step by the reference point inputted at the input step 
and composing the video data in one video; and 

saving and displaying the composed video data at the 
calibrating step. 
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